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[57] ABSTRACT 

A system performing capture and display of both still and 
real-time motion picture panoramic images comprised of 
360 degrees in azimuth and ±180 degrees in declination for 
a virtual spherical field of view wherein image capture is 
achieved via a horizontally scanned vertical slit image 
passing through a fish-eye lens, mirrors, and prisms rotated 
under servo motion control onto a stationary line-scan 
sensor to build up a continuous two dimensional image. A 
host computer system monitors a position encoder on the 
optical head, sends motion commands to the servo 
controller, controls sampling rate and integration time for 
the line-scan sensor, and does image data processing, 
encoding, and storage. Additional mechanisms in the optical 
head permit optical and solid-state image magnification, 
selective field of view and sub-sampling of pixel data, 
optical horizon shifting, and streak and slit-scan camera 
effects. Image display is possible either through various 
methods of mapping the spherical image to a conventional 
flat display, or using the same optical head to project the 
image onto the interior of a spherical screen. Synchronous 
image scanning and projection from a single optical head is 
accommodated. Variations on the optical head includes 
options for stereoscopic imagery and miniaturized optics. 
Designs permitting both adaptive and interactive control of 
image capture and display are presented 

26 Claims, 7 Drawing Sheets 
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DIGITAL VIDEO PANORAMIC IMAGE restricts the arimwthal range to less than 360 degrees. This 

CAPTURE AND DISPLAY SYSTEM invention doesn't address real-time video. 

A panoramic periscope for two spectrum ranges (U.S. Pat 

BACKGROUND OF THE INVENTION Na 5,022,723, Schmidt et al) shows a panoramic periscope 

I Held of the Invention 5 wh ich uses a spectrum divider in the optical path to permit 

i Description Relative to the Prior Art bispectral viewing, such as day and night It does not have 

M ^~ ... • « « - . an image counter-rotating prism, The design does not 

me present invention relates to video-rate panoramic ^^dco-rate £ projection, 

recording and projection systems which use an image dero- . . < 

tator to Lou£e the rotation of the optics from the sensor 10 ^lens system for360 ^panoramic viewing and 

so that the sensor is stationary. SuchVystems are used for 10 ™ if"**™™ < US 1 Pat 

both optical and infrared spectra and have a 360 degree No - ^ 95 ;°^ et aix ms design uses a large 

anniuarTecordine window numbcr of °P bcal ^^^^ which increases costs. The 

aimuj^recoraing window. system has a 36(Wcgrcc annular field but the vertical range 

In the following discussion^e term 'nhree^nsional ' ^ 180 Another lens system (U.S. Pat No. 

image- is used to mean the incident ligfrt which provides an 15 4 m m C o*) irnprov* the Roseiidahl design by requir- 

T" T £? rJT^i 1 ^^ 8 H^^^ ing femr leoseVand by providing impro^response to 

whereto this incident light is the result of illuminating a ^ ^ ^ liowever, ttosystem 

tridimensional object or objects. ^ ^ J^d^ vcrdcal ^ 

The term "light" is used to mean electromagnetic A m ^ intmd ^des a 

radiation, irrespective of the wavelength mvolved.The most 20 ^ oraadc ^ ^ Pat No . 4 ,977323, Jehle). The 

common waveleng^ tome systems o^enbed herein are in capture sub-system of the Jehle 

fcejorible and infra^^ons; however, other [P artt of £e *™^on ^ coupieTby using the output of the 

spectrummay be appropriately used in conjunction with this to Myt th / ampl ^ ers ^led*. B uscs two stages 

invention. of detectors in which the first stage of infrared detectors are 

The term "azimuth", together with its variants is used to 25 usc 4 xo drive optical detectors. However, this system does 

mean an angular displacement in the plane of the horizon. not provide 180 degree vertical view and has no record 

The term "declination", together with its variants, is used capability. It uses a derotator prism on the capture side to 

to mean an angular displacement in the vertical direction, or decouple to driver optics from the rotating projection lenses, 

in the direction normal to the horizon. A 360 degree optical surveillance system (U.S. Pat No 

The prior art teaches panoramic recording systems of 4,982,092, Jehle) provides a different coupling. The projec- 

various kinds, some of which use derotation, and some of (ton sub-system and capture sub-system are directly coupled 

which also allow recording and projection of a 360 -degree. by U5m g the output of the detectors to drive the amplifiers 

wide-angle vertical image area. However, the present inven- for LEDs. This system runs at Vtoth second rate per pan- 

tion not only allows for mis expanded coverage, but further oramic image, but it does not provide 180-degree vertical 

provides for video-rate capture. In addition, the present view or a record capability. It uses a derotator prism on the 

invention accomplishes this task with a novel combination capture side and doesn't permit the same optics to be used 

of elements which can be inexpensively and easily manu- for both capture and projection. 

factored. The present invention utilizes a scanning technique in 

The still-image slit scan panoramic camera (U.S. Pat No. ^ which a three-dimensional image is constructed by scanning 

4,241,985, Globus ct al) is an early panoramic camera with the field of view with a wide-angle, or "fish-eye** lens 

film recording. It features radial rotation of a slit over incorporated into the scanning head. It is essential that the 

photographic film with a speed governor to ensure uniform fish-eye lens provide a wide angle of capture in the vertical, 

imaging. It does not address video-rate capture or projection. or altitudinal direction. However, only a thin vertical slice of 

It does not address 180 degree vertical capture. 45 this image, located near the image center, is used. The 

The line-scan panoramic TV camera (U.S. Pat No. 4,532, scanning head is rotated in the horizontal, or arimuthat 

544, Federau) is a rotating optical assembly which images direction. As the scanning head is thus rotated, the vertical 

onto a linear array sensor, and which is coupled to a image slice paints the image onto the recording surface, 

stationary base with electronics and power passed through a Previous panoramic cameras paint the image onto an annu- 

multichannel optical rotary joint without mechanical con- ^ lus or ring, or project the image onto a rectangular strip. The 

tacts. The linear sensor is displaced coaxially from the slit so Jehle U.S. Pat No. 4,982,092 describes such a process in 

that the head optics can be minimized in size for applications detail. 

which require camera insertion in small openings. This The present invention avoids the necessity for an annular 

design requires a rotating signal transmission unit which recording surface. Instead, it uses a linear array of detectors 

increases costs. However, the design does not allow a 180 55 to record the image slice as a series of dots, or pixels, 

degree vertical view of the image. arranged in a vertical line. The use of such linear arrays Is 

A panoramic camera (U.S. Pat No. S262&61, Kojima) well known in digital photographic applications. When an 

for object search records three dimensional position, image is focused on the array, each sensor in the array 

azimuth, focus amount and zoom amount with each pan- provides an electrical signal proportional to the intensity of 

oramic image. However, Kojima does not disclose or claim 50 light incident upon that sensor. The resulting electrical 

a method or apparatus for implementing the scanning of the signals may then be stored dectronicaUy, and can be used to 

panoramic image, and docs not appear to be suitable for reconstruct the image which generated the signals. Tlus 

video rate image recording. electronic image storage is contrasted to the traditional 

A panoramic camera with objective drum (U.S. Pat Na means of storing light images on photographic film. 

5305,035, Schonherr et al) images onto a rotating objective 65 These detectors are effective in both visual and infra-red 

drum through a slit with li^t-catching grooves located near portions of the spectrum. Accordingly, the current invention 

the edges of the imaging window. The i™ aging window may be used for bom optical and infra-red applications. A 
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discussion of this subject may be found in L. J. KozlowsM, 
W. E Kosonocky, Infrared Detector Arrays", in Handbook 
of Optics, vol 1, pp. 23. 1-23 37. 

As the panoramic scanning proceeds, the vertical image 
slice is constantly projected onto the linear detector array, 3 
whose time- varying outputs are stored for later processing, 
or processed in real time. 

Maintaining the image slice on the linear detector array 
requires that either the array be moved synchronously with 
the scanning head, or mat the image be "derotated" by 10 
optical system means which reduce the moving image slice 
from the scanning head to the stationary image slice focused 
on the detector array. 

In the present invention the "derotatiocT approach is used 
in the preferred embodiments- 15 

The use of detector arrays is now becoming common in 
photographic applications. Its should be noted, however, mat 
the technique of wiping an image across a linear array of n 
elements has some inherent advantages as opposed to using 
a two-dimensional array of nxm elements, which constitutes ^ 
a competing implementation. The use of the linear array 
requires the manufacture of a significantly smaller number 
of elements per detector, thus reducing the effects of yield on 
cost. For instance, a 1000 by 1000 grid of detectors contains 
1,000,000 elements. Manufacturing a grid of mis size with M 
no defects requires the discarding of a substantial number of 
exemplars before producing a perfect array. On the other 
hand, the same effect may be obtained by wiping an Image 
across a linear array of 1000 elements. Producing a perfect 
1000 element linear array can be done much more cost ^ 
effectively, due the substantially higher yield effected during 
the manufacture of such a linear array, as compared to the 
1,000,000 element array. 

The manufacturing yield of defect free sensors is largely 
dependent of the probability of single sensor site detect and 35 
the total number of sites per sensor. Consequently, commer- 
cially available linear arrays have a maximum resolution in 
one axis of just over 8000, whereas maximum resolution of 
area arrays is limited to about 1000 in each axis. For these 
reasons, even as manufacturing processes achieve higher ^ 
resolutions, we can expect our design based on using a linear 
array will always provide higher resolution than systems 
based on using area sensors. 

A further consideration in the number of array elements in 
the camera is the impending use of high-definition TV 45 
(HDTV). For this application, the number of array elements 
should be equal or greater Chan 2000, which is the upper 
limit of the vertical dimension of standards for HDTV. 

It is further noted that the present invention may be 
implemented with or without an totermediate storage device, 50 
In the instance where the result of the panoramic scan is 
viewed in real time, the output of the linear array may be 
processed into a real-time display without the need for 
storage. On the other hand, the output of the array may be 
stored electronically far later use. Another alternative is to 55 
expose photographic film which moves in the direction of 
the scan during exposure. 

A final advantage of the current invention is the reduction 
or control of "aliasing", or distortion of objects which have 
a motion component in the direction of panoramic scanning. 60 
Aliasing is a well-known effect in panoramic photography, 
and it is sometimes purposely done for the special effects it 
produces in photographs. The current invention can be used 
to nunimize ^foging due to the inherently high speed of the 
scan. Alternatively, aliasing can also be purposely produced 65 
and controlled using the present invention, because of the 
invention's inherent ability to control the scanning speed. 
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SUMMARY OF THE INVENTION 

The limitations and disadvantages of the prior art dis- 
cussed above are overcome by the present invention. It is an 
object of the present invention to allow video rate (30 
rotations per second or more) recording and projection of 
360 degree azimuth and 180 degree vertical scenes. 

It is a further object of this invention to provide for said 
video rate, wide-angle recording and projection without 
complex or unusual lens assemblies or costly coupling 
electronics between a rotating head and rotating sensor or 
optical emitter. 

It is a still further object of this invention to provide a 
complete and uniform imaging of the sphere of view, with 
a minimum of annular distortion. 

According to one aspect of the invention, a panoramic 
digital video camera for recording incident light from three- 
dimensional images comprises a scanning head comprising 
a rotating wide-angle lens which collects the incident light, 
fmmnthal mean s of rotating the scanning head, a linear array 
sensor axis, optical means for projecting the light from the 
lens onto the sensor, and means for maintaining the light 
projected from the lens stationary on the sensor during 
scanning When the scanning head is rotated a vertical slice 
of incident light collected by the lens is constantly projected 
onto the sensor array, which produces an electrical signal 
from which the image can be reproduced* 

According to another aspect of the invention the optical 
means for projecting the light from the lens stationarily on 
the sensor during scanning further comprises a 45 degree 
front surface mirror, a dove prism counter-rotated to the 
scanning head, a first achromatic relay lens, a second 
achromatic relay lens, and a front-surface mirror. 

The incident light from the lens is reflected along the axis 
of rotation by the 45 degree front surface mirror, which then 
is relayed by the achromatic relay lens to the dove prism 
which derotates the image and passes it to the second relay 
lens which converges the image onto the front-surface 
mirror which then projects the image stationarily onto the 
sensor array. 

According to still another aspect of the invention the 
front-surface mirror is replaced by a beam-splitter which 
passes incident light from an emitter array back through the 
optical system for projection onto a spherical surface, while 
the incoming image is imaged onto the linear sensor array. 

According to yet another aspect of the invention the linear 
array is of the type which allows images to be captured, 
stared and projected at rates of 30 or more images per 
second. 

According to still another aspect of the invention the 
camera further comprises means for recording the images 
sensed by the linear arrays. 

According to a final aspect of the invention two identical 
cameras are fixed in location with respect to each other at a 
stereographic separation, whereby the two cameras together 
may be used to produce stereoscopic images and recordings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 depicts a side cross-section view of the optical 
system for optical or infrared recording. 

FIG. 2 depicts a side cross section of the optical system 
for simultaneous recording and projection. 

FIG. 3A depicts a top view of the stereoscopic panoramic 
record system. 

FIG. 3B depicts a side cross-section view of the stereo- 
scopic panoramic record system. 
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FIG. 4 depicts a side cross-section view of the sensor and recording. It is expected that for projection, a high- 
system far horizon control. intensity (i.e., 30x brighter than normal systems for given 

FIG. 5 depicts the embodiment utilizing a miniaturized distance from screen) projection beam is needed to corn- 
head with flexible optical bundle system. pensate for the scanning method of projection used here, and 

FIG. 6 depicts a block diagram for an embodiment in 5 mgher than 30 revolutions per second may be 

which additional sensor data is recorded with, or used to ***** to aV0ld Ac perception of flicker, 

trigger the recording of the video data. Panoramic scenes can have large light intensity variations 

FIG. 7 depicts an array of directional microphones used in cxtend dynamic range of sensors and display 

conjunction with the panoramic camera in one of the pre- devices, m this invention, dynamic control of the integration 

ferred embodiments 10 timc of ^ sensor is used to normalize intensities in the 

FIG. 8 depicts a spherical display module used in con- horizontal dkection so that a shorto imegration time is used 

juntf ™ wtoto Jan^Scam^ for ^tensity ^c^sflces. In this mvention^mtensity 

juacaoD wim wc panoramic utiuaa. variation in the vertical direction is normalized by scaling 

DETAILED DESCRIPTION OF THE the samples after the samples have been shifted out of the 

PREFERRED EMBODIMENTS 15 sensor into a secondary buffer or frame grabber. In both 

_ . A - . ■ « ... cases, dynamic range correction can be controlled either 

The invention uses a rotating scanning head which con- «j ***"»^ 

, TT . " V^r """"hi wuivm v« automaticallv or bv the user of the panoramic camera, 

tains a fish-eye lens orthogonal to the axis of rotation. The auwmauwuiy « uic usu ui wc * wuuiam11 ' ^ 

fish-eye lens provides a 180 vertical view, while the rotation ^ P 0 ** 00 of ^nt surface mirror 

of the lens provides a 360 degree azimntha! view, together „ sensor with respect to the axis of the light flow can be varied 

providing a complete and uniform imaging of the sphere of from the 45 degree position to control the position of the 

view. Annular distortions are minimized by using a motor horizon in the image. Increasing the angle raises the horizon. 

drive which is linear with minimal rotational variation. decreasing the angle lowers the horizon. The sensor 

Vertical distortion is minimized by using only a narrow mount angle and displacement can be adjusted manually or 

vertical slice from the fish-eye lens. Geometrical distortion „ b Y motorized control to control the focus of the incident 

found in systems which create a panoramic scene from a ima S e when mc front surfacc minos: » adjusted. 

mosaic of two 'fim*ffg'"'"i individually recorded areas is Using nucro-optic techniques, the scanning optics inctud- 

eliminated because of the construction of the panoramic ing lens and mirror can be miniaturized. This permits the 

image from very fine vertical slices of the original scene. head to be inserted into small diameter openings. To permit 

Light from the fish-eye lens is reflected along the axis of ^ the mechanical "coupling" of the rotational axis of the 

rotation by a 45 degree front surface mirror. An achromatic scanning optics from the axis of rotation of the derotator, the 

relay lens is used to extend the focal length of die lens output of the scanning head mirror can be transrmtted over 

system. After the first relay lens is a dove prism which a fiber optic bundle to the derotator prism assembly. This 

derotates the image and which is counter-rotated to the decoupling means that the axis of the scanning optics need 

scanning head at half the rotational speed. A second relay 35 not t* coilinear with the axis of the scanning optics, thus 

lens converges the image onto a stationary linear array penmtting greater flexibility in the layout of the optical 

sensor. The rotational movement of the head scans out a 360 system. 

degree annular view, with each vertical slice of the pan- The rotating mirror reflects onto a fiber optic bundle 
orama coming from the fish-eye lens and being imaged onto which carries the image to an arbitrarily distant paint for 
the linear array. Single panoramic images, video-rate pan- ^ transmission to the counter-rotating prism and related optics, 
oramic movies, and very high frame-rate panoramic Images The rotating head is driven by a remote motor, coupled by 
can all be recorded, due to the response time of the linear a small diameter cable that is parallel with the fiber optic 
arrays as well as die inherent ability of the current invention bundle and whose end is moved by the motor to rotate the 
to operate at scanning speeds beyond thirty revolutions per head. The miniaturized rotating head and the counter- 
second, a typical *m Tripling rate used to achieve smooth 45 rotating prism assembly are synchronized in a 2:1 ratio, 
motion rendition. Sampled images are written to a frame Stereoscopic recording is obtained by imaging two later- 
store and displayed at 60 Hz or more where the flicker rate ally displaced light paths through the same derotational 
is higher man that noticeable by human beings. Frame rate assembly to two different linear arrays which represent the 
is fctennined by the rotational speed of the camera, the left and right view of the stereo image. The lateral displace- 
integration period of the sensor, and the average intensity of x meat is made sufficient to obtain depth -of-fi eld perception, 
the incident light Stereoscopic projection is obtained by transmitting the out- 
Those familiar with the art will recognize that linear array put of the emitters along the light path in the reverse 
sensors are manufactured in various number of sensor direction. 

elements and spectral responses. The number of vertical The first embodiment, as depicted in FIG. 1, shows the 
samples in the digitized image is determined by the number 55 optics for 360 degree annular and 180 azimuth imaging at 
of sensor elements in the linear array. The number of imaging rates of 30 or more rotations per second. A mount- 
horizontal samples in the digitized image, for a given frame ing plate 3 supports base plate 2 through four cylindrical 
rate, depends on the sensitivity and the integration time of standoffs 4. Motor 8 fitted with encoder !• drive shaft and 
the sensor. Subsampling of the output of the linear array can gear assembly 12 to derotator assembly 36 drive gear 46, 
be used to obtain images with lower vertical and horizontal 60 which drives the idler gear 16 through idler shaft 14 to idler 
sample resolution. gear 18. Idler gear 18 drives the rotation of the scanning 
Further, using a beam splitter in the axis plus sensors wim assembly 22 through the scanning assembly gear 26. 
desired spectral responses can permit simultaneous capture Alternatively, gear 16 can be removed and shaft 14 con- 
of multiple spectral ranges. Similarly, a beam splitter that verted to a drive shaft for a second motor which can rotate 
sends incident light along the forward path to the sensor and 65 the scanning assembly 22 independently of the derotation 
passes along the reverse path the output of a projector assembly 36 to produce visual affects such as slanting or 
permits the system to be used for simultaneous projection skewing of the image. 
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Light enters through fish-eye lens assembly 20 which is resolution for the given field of view and producing an effect 

mounted to the scanning assembly 22 and counter balanced known as zooming. For a given frame rate, the horizontal 

by the weight 28. Light is incident on the front surface resolution of the image is determined by the linear array 

mirror 24 of the scanning assembly. Light enters the first sensor sensitivity and the sensor integration time. Higher 

achromatic relay lens 34 of the derotator assembly 36. Light 5 sensitivy and lower integration times allow the linear array 

passes through the derotator dove prism 32 then exits the sensor to be clocked more frequently, permitting more 

second achromatic relay lens 38 to the front surface mirror horizontal samples for a given rotational speed of the 

42 to be incident on the linear array 44. scanning head. As the rotational speed of the scanning head 

Shroud 3© encloses and is attached to the optical head is reduced, toe number of samples for the horizontal field of 

scanning assembly 22 so mat the shroud rotates with the 10 view increases. 

scanning assembly. Derotator assembly 36 rotates in a A sixth embodiment shows the invention mcorporating 
counter direction to scanning assembly 22, and at half the additional sensors for triggering the recording of a pan- 
rotational rate, while the linear array 44 and mounting plate aramic image on to an external storage media or providing 
3 are fixed. additional data that is recorded with the video data. A sensor 

A second embodiment, as depicted in FIG. 2, performs 15 providing navigational information, including altitude, lati- 

simultaneous projection and recording. The front surface tude and longitude position can be used to record the 

mirror 42 in FIG. 1 is replaced in FIG. 2 by a beam splitter earner a^s position during video data recording. A sensor can 

50. A linear array of optical emitters or other optical pro- directly P*** 55 the data from the linear 

jector 46 emits tight onto front surface mirror 48, is passed array, for example performing motion detection or object 

through toe beam splitter 50 and then along the reverse 20 identification, to trigger the recording of the video data, 

direction of toe recording light path through the optic Other sensors include current time, infrared, motion 

assembly described in FIG. L detection, and ambient light intensity. FIG. 6 depicts a block 

A third embediment, as depicted in FIGS. 3A and SB, dia « nun <* ^ embodiment 

performs stereoscopic recording. Two fish-eye lenses are „ Referring now to FIG. 6, the panoramic video camera 86 

mounted displaced horizontally by toe mter-occular dis- 25 produces digital data 87 which is received by a data input 

tance. The output of each lens goes to a sequence of front interface 95 of toe recording device 88. The digital video 

surface mirrors 55 and 56 which channel the left field of data is also received by an Image Analyzer 90 which process 

view through toe derotator, and 58 and 59, which channel the video data to detect motion, specific object features, 

toe right field of view through toe derotator, and by means „ scene changes or other attributes of toe video data. The 

of which the light paths, slightly displaced, are directed output of toe image analyzer 97 is received by toe trigger 

through the dcrotating prism assembly. Another displaced input 93 of the recording device 88 to signal when recording 

mirror 52 in the base intercepts one of toe light paths and of toe video data should begin and end. 

sends it to toe sensor 57 while the other sensor 54 receives One or more sensors 84 produce sensor data 85 which is 

toe second light path. 35 received by a data input interface 89 of the recording device 

A fourth embodiment, as depicted in FIG. 4, teaches toe 88 ft* recording with toe video data. The sensor data is also 

addition of a stationary rack 60 and two independent pinions received by trigger input 91 of the Recording Device to 

for horizon control. Pinion 62 controls rotation and displace- indicate when the recording of the video data should begin 

ment of toe front surface mirror and pinion 64 controls at"* end. 

angular position and displacement of toe linear array sensor ^ An seventh embodiment shows that existing directional 

or emitter. The two pinions can be used to change toe microphones can be combined with the panoramic camera to 

position of the horizon while retaining focus. provide simultaneous panoramic audio and video capture. 

A fifth embediment, as depicted in FIG. 5, utilizes a Such directional microphones can be mounted at the base of 

detached and miniaturized head Arriiniature lens 66 images toe camera at different radial angles to provide sufficient 

onto a mirier 68 and are b^encl^ 45 field coverage in each direction. Hie recorded multi-channel 

70. The mirror 68 images onto a coherent flexible fiber optic audio signal can be used by existing audio production and 

bundle 72 which is enclosed in a flexible cylindrical sheath- presentation systems to re-create a three-dimensional sound 

ing 74. A drive wire conduit 76 is also enclosed in toe sensation during projection and viewing of toe panoramic 

cylindrical sheathing 74. The drive wire 78 is enclosed in the video, and allow toe user to pan or zoom toe panoramic 

drive wire conduit 76 and is attached to a pinion gear 80 50 image in the direction of specific sounds. FIG- 7 depicts this 

which meshes with a ring gear 82 to turn the lens andmiiror embodiment, and shows an octagonal array of 8 

assembly. The fiber optic bundle 72 projects the transmitted microphones, 92, 94, 96, 98, 100, 182, 104, and 1*6, 

light onto the dcrotating prism assembly for reception by toe grouped around a central axis 188, which is also toe axis of 

stationary linear array as before. The fiber optic bundle 72, rotation of the scanning head of the camera, 

enclosing conduit 76, and transparent globe 77 are non- 55 An eighth embodiment, depicted in FIG. 8 shows a 

rotating. Additional conduits can be added into toe fiber spherical display module 110 in which a viewer 112 is seated 

bundle sheathing 74 to provide features such as a light in a rotating chair 114. The chair is pysically rotatiable. The 

source at toe head, remote control of toe orientation of toe image captured by toe panoramic camera is projected by 

head, or other m ffr ^ nnjf>fll manipulators. means of projector 118 onto the Inner surface of toe sphere. 

For digitized high resolution still panoramic images the 60 The viewer may paD or tilt the projected image a mouse 116 

vertical and horizontal resolution limits are determined as which senses attitude and orientation by means of an internal 

follows. For a given vertical field of view, vertical resolution micro-gyroscope, or toe equivalent This rotation may be 

of the final image is directly determined by the number of either m azimuth, declination, or both, depending upon toe 

sensor elements in toe linear array. The maximum vertical orientation of toe mouse. 

field of view for the camera is 180 degrees, but by changing 65 Obviously many modifications and variations of the 

toe linear array sensor angle (sensor skewing), the vertical present invention are possible In light of the above teach- 

field of view can be lowered, effectively increasing toe ings. It is therefore to be understood that within the scope of 
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the appended claims the invention may be practiced other- 
wise than as specifically described. 

What is claimed as new and desired to be secured by 
Letters Patent of the United States is: 

1. A panoramic digital video camera for recording inci- 
dent light from three-dimensional images comprising: 

a scanning head comprising a rotating wide-angle lens 

which collects the incident light; 
flrimirthal means of rotating the scanning head; 
a linear array sensor axis; 

optical means for projecting the light from the lens onto 

the sensor, which includes: 

a 45 degree front surface mirror; 

a dove prism counter-rotated to the scanning head; 

a first achromatic relay lens; 

a second achromatic relay lens; and 

a front-surface mirror; and 
means fox maintaining the light projected from the lens 

stationarily on the sensor during scanning, 
whereby when the scanning head is rotated a vertical slice of 
light collected by the lens is reflected along the axis of 
rotation by the 45-degree front surface mirror, which then is 
relayed by the achromatic relay lens to the dove prism which 
derotates the image and passes it to the second relay lens 
which converges the image onto the front-surface mirror 
which men projects the image stationarily onto the sensor 
array, an electrical signal is produced from which the image 
can be reproduced. 

2. The camera according to claim 1, wherein the front- 
surface mirror is replaced by a beam-splitter which passes 
incident light from an emitter array back through the optical 
system for projection onto a spherical surface, while the 
incoming image is imaged onto the linear sensor array. 

3. The camera according to claim 2 wherein the linear 
array is of the type which allows images to be captured, 
stored and projected at rates of 30 or more images per 
second 

4. A high-resolution camera according to claim 3, wherein 
the number of array elements is equal to or greater than 
2000, whereby the camera may be used in conjunction with 
HDTV images. 

5. The camera according to claim 4, further comprising 
means for adjusting the front surface mirror, and in which 
the azmwthal span is controlled by adjusting said front 45 
surface mirror. 

6. The camera according to claim 5, farther comprising 
means for adjusting the linear array, and in which the 
arimuthal resolution may be varied with varying azimuth 
angles by controlling said linear array. 

7. The camera according to daim 6 in which by additional 
sensors, navigational position information can be used to 
trigger the automatic capture of an area, and camera position 
and orientation data can be recorded with each image. 

8. The camera according to claim 4. wherein the optics 
and linear arrays permit display and recording of both 
optical and infra-red images. 

9. The camera according to claim 6 further comprising: 
means to control intensity of the image at the linear array 

sensor and 
means to normalize the input data, 
whereby horizontal intensity correction at the camera are 
performed by intensity control means; and vertical intensity 
corrections are performed by said means to normalize the 
input data. 

10. Hie camera according to claim 6. further comprising 
a flexible fiber optic cable located between the fish-eye lens 



and the means for denotation of the image, whereby the 
means for dcrotation are physically decoupled from the 
scanning head. 

11. The camera according to claim 6 further comprising a 
second means of control over the scanning head, said second 
means of control being independent of the first means of 
control, whereby certain real-time specific effects or con- 
trolled distortions, such as slanting or stretching of the 
picture can be created thereby. 

12. The camera according to claim 6 further comprising; 
a system of directional microphones; 
means for detenniiung the direction of a sound from the 

output of the microphone system, and 
means for controlling the scanning head are controlled by 
the sound direction, whereby audio directionality can 
be recreated during projection using conventional 
audio techniques. 

13. The camera of claim U. further comprising: 
a spherical viewing module having an interior viewing 

surface and containing a viewing position; 
means to process the output of the sensor array; 
means to convert the processed output of the sensor array 

into a display image; 
means to project the display image on the interior surface 

of the viewing module; and 
means to rotationaUy control the relative position of the 
display image and the viewing position, 
whereby when a viewer is located at the viewing position 
30 within the viewing module, a realistic reproduction of the 
display image may be seen by the viewer on the interior 
surface of the viewing module, and may be moved relative 
to the viewer. 

14. The camera according to one of claims 1 through 12, 
further comprising means to stare the output of the sensor 
array. 

15. A panoramic digital video camera for recording inci- 
dent light from three-dimensional images comprising: 

two scanning heads, each comprising a rotating wide- 
angle lens which collects the incident light, said heads 
being fixed in location with respect to each other at a 
stexeographic separation; 
azimuflmi means of rotating the scanning heads; 
two linear sensor arrays, one corresponding to each scan- 
ning head; 

optical means for projecting the light from the two lenses 

onto the sensor arrays; 
means for maintaining the light projected from the lenses 
stationarily on file sensors during scanning; 
whereby when me scanning heads are rotated a vertical slice 
of incident light collected by each lens is constantly pro- 
jected onto the corresponding sensor array, which produces 
electrical signal from which the image can be stereoscopi- 
calfy produced and recorded. 

16. The camera according to claim 15 wherein the linears 
array are of the type which allows images to be captured, 
stored and projected at rates of 30 or more images per 
second 

17. A high-resolution camera according to daim 16, 
wherein the number of array elements in each array is equal 
to or greater than 2000, whereby the camera may be used in 
conjunction with HDTV images. 

18. The camera according to claim 17, wherein the optical 
means for projecting the light from the lens stationarily on 
the sensor during scanning further comprises 45 degree front 
surface mirrors, further comprising means for adjusting the 
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front surface mirrors, and in which the ayiTnuthfli span is 24. The camera according to claim 21, further comprising 

controlled by adjusting said front surface mirrors. a flexible fiber optic cable located between each wide-angle 

19. The camera according to claim 17* wherein the optics \ cn8 m & the means for derotation of the image, whereby the 
and linear arrays permit display and recording of both meaB& for 4^^^^ m physically decoupled from the 
optical and infra-red images. 5 ^ - nft y. Mtic 

20. The camera according to one of claims 17 through 19, scanning neaos. 

further composing means to store the output of the sensor 25. The camera according to claim 21* further comprising 

arrays. a second means of control over the scanning heads, said 

21. The camera according to claim 18, further cornprising second means of control being independent of the first 
means for adjusting the linear arrays, and in which the 0 f control, whereby certain real-time specific effects 
azimuthal resolution may be varied with varying azimuth 10 „ . ' J , ( rt * , . ... 
angte by controlling said linear arrays. or controlled distortions, such as slanting or stretching of the 

22. The camera according to claim 21, in which by picture can be created thereby. 

additional sensors, navigational position information can be 26. The camera yrnf-Hing to claim 21 further comprising; 

used to trigger the automatic capture of an area, and camera . m , mvrflftnM , 

position and orientation data can be recorded with each „ a ****** of directional microphones, 

image. means for determining the direction of a sound from the 

23. The camera according to claim 21, further comprising: output of the microphone system, and 

means to control intensity of the image at the linear array means for controlling the scanning heads are controlled 

sensors and by the sound direction, 

w S y S Z™^SS^£on at the camera are ^ whereby audio ^on^ter*^ during pre 

32 Intensity cZl means; and vertical intensity conventional audio techniques, 
corrections are performed by said means to normalize the 

input data. ***** 
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